METHOD AND DEVICE FOR PROCESSING VIDEO DATA FOR DISPLAY ON A 

DISPLAY DEVICE 

5 The present invention relates to a method for processing 

video data for display on a display device having a plural- 
ity of luminous elements by applying a dithering function to 
at least a part of the video data to refine the grey scale 
portrayal of video pictures of the video data. Furthermore, 
10 the present invention relates to a corresponding device for 
processing video data including dithering means. 

Background 

is A PDP (Plasma Display Panel) utilizes a matrix array of dis- 
charge cells, which can only be "ON", or "OFF" . Unlike a CRT 
or LCD in which grey levels are expressed by analogue con- 
trol of the light emission, a PDP controls the grey level by 
modulating the number of light pulses per frame (sustain 

20 pulses) . This time-modulation will be integrated by the eye 
over a period corresponding to the eye time response. Since 
the video amplitude is portrayed by the number of light 
pulses, occurring at a given frequency, more amplitude means 
more light pulses and thus more "ON" time. For this reason, 

25 this kind of modulation is also known as PWM, pulse width 
modulation. 

This PWM is responsible for one of the PDP image quality 
problems: the poor grey scale portrayal quality, especially 

30 in the darker regions of the picture. This is due to the 
fact, that displayed luminance is linear to the number of 
pulses, but the eye response and sensitivity to noise is not 
linear. In darker areas the eye is more sensitive than in 
brighter areas. This means that even though modern PDPs can 

35 display ca. 255 discrete video levels, quantization error 
will be quite noticeable in the darker areas. 
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As mentioned before, a PDP uses PWM (pulse width modulation) 
to generate the different shades of grey. Contrarily to CRTs 
where luminance is approximately quadratic to applied cath- 
5 ode voltage, luminance is linear to the number of discharge 
impulses. Therefore an approximately digital quadratic gamma 
function has to be applied to video before the PWM. 

Due to this gamma function, for smaller video levels, many 
10 input levels are mapped to the same output level. In other 
words, for darker areas, the output number of quantization 
bits is smaller than the input number, in particular for 
values smaller than 16 (when working with 8 bit for video 
input) that are all mapped to 0. This also counts for four 
15 bit resolution which is actually unacceptable for video . 

One known solution to improve the quality of the displayed 
pictures is to artificially increase the number of displayed 
video levels by using dithering. Dithering is a known tech- 

20 nique for avoiding to loose amplitude resolution bits due to 
truncation. However, this technique only works if the re- 
quired resolution is available before the truncation step. 
Usually this is the case in most applications, since the 
video data after a gamma operation used for pre-correction 

25 of the video signal has 16 -bit resolution. Dithering can 

bring back as many bits as those lost by truncation in prin- 
ciple. However, the dithering noise frequency decreases, and 
therefore becomes more noticeable, with the number of dith- 
ered bits . 

30 

The concept of dithering shall be explained by the following 
example. A quantization step of 1 shall be reduced by dith- 
ering. The dithering technique uses the temporal integration 
property of the human eye. The quantization step may be re^ 
35 duced to 0,5 by using 1-bit dithering. Accordingly, half of 
the time within the time response of the human eye there is 
displayed the value 1 and half of the time there is dis- 
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played the value 0 . As a result the eye sees the value 0,5. 
Optionally, the -quantization steps may be reduced to 0,25. 
Such dithering requires two bits. For obtaining the value 
0,25 a quarter of the time the value 1 is shown and three 
5 quarters of the time the value 0 . For obtaining the value 

0,5 two quarters of the time the value 1 and two quarters of 
the time the value 0 is shown. Similarly, the value 0,75 may 
be generated. In the same manner quantization steps of 0,125 
may be obtained by using 3-bit dithering. This means that 1 
10 bit of dithering corresponds to multiply the number of 

available output levels by 2, 2 bits of dithering multiply 
by 4, and 3 bits of dithering multiply by 8 the number of 
output levels. A minimum of 3 bits of dithering may be re- 
quired to give to the grey scale portrayal a 'CRT' look. 

15 

Proposed dithering methods in the literature (like error 
diffusion) were mainly developed to improve quality of still 
images (fax application and newspaper photo portrayal) . Re- 
sults obtained are therefore not optimal if the same dither- 
20 ing algorithms are directly applied to PDPs and mainly in 
the displaying of video with motion. 

The dithering most adapted to PDP until now is the Cell- 
Based Dithering, described in the European patent applica- 
25 tion EP-A-1 136 974 and Multi-Mask dithering described in 
the European patent application with the filing number 01 
2 50 199.5, which improves grey scale portrayal but adds high 
frequency low amplitude dithering noise. It is expressively 
referred to both documents. 

30 

Cell -based dithering adds a temporal dithering pattern that 
is defined for every panel cell and not for every panel 
pixel as shown in Fig. 1. A panel pixel is composed of three 
cells: red, green and blue cell. This has the advantage of 
35 rendering the dithering noise finer and thus less noticeable 
to the human viewer. 
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Because the dithering pattern is defined cell-wise, it is 
not possible to use techniques like error-diffusion, in or- 
der to avoid colouring of the picture when one cell would 
diffuse in the contiguous cell of a different colour. This 
5 is not a big disadvantage, because it has been observed 

sometimes an undesirable low frequency moving interference, 
between the diffusion of the truncation error and a moving 
pattern belonging to the video signal. Error diffusion works 
best in case of static pictures. Instead of using error dif- 
10 fusion, a static 3 -dimensional dithering pattern is pro- 
posed. 

This static 3 -dimentional dithering is based on a spatial (2 
dimensions x and y) and temporal (third dimension t) inte- 

15 gration of the eye. For the following explanations, the ma- 
trix dithering can be represented as a function with three 
variables: </>(x,y,t). The three parameters x, y and t will 
represent a kind of phase for the dithering. Now, depending 
on the number of bits to be rebuilt, the period of these 

20 three phases can evolve. 

Figure 2 illustrates the 3 -dimensional matrix concept. The 
values displayed on the picture slightly change for each 
plasma cell in the vertical and horizontal directions. In 
25 addition, the value also changes for each frame. 

In the example of figure 2, for the frame displayed at time 
t 0 the following dithering values are given: 

0 (x 0 ,y 0 ,t 0 )=A 

30 $ (x 0 +l,y 0 , t 0 ) =B 

4> (x 0 +l,y 0 +l, t 0 ) =A 

4> (x 0 ,y 0 +l, t 0 ) =B 

One frame later, the dithering values are at time t Q +l : 

35 

<f> (x 0 ,y 0 , t 0 +l) =B 

0 (x 0 +l,y 0 , t 0 +l) =A 
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4> (x 0 +l,y 0 +l/ t 0 +l) =B 
<t> (x 0 ,y 0 +l, t 0 +l) =A 

The spatial resolution of the eye is good enough to be able 
5 to see a fixed static pattern A, B, A, B but if a third di- 
mension, namely the time, is added in the form of an alter- 
nating function, then the eye will be only able to see the 
average value of each cell. 

10 The case of a cell located at the position (x 0 ,y 0 ) shall be 
considered. The value of this cell will change from frame to 
frame as following <f> (x Q/ y Q , t Q ) =A, 0 (x Q , y 0 , t Q +l) =B, 
0 (x 0 ,y 0 / 1 0 +2) =A and so on. 

15 The eye time response of several milliseconds (temporal in- 
tegration) can be then represented by the following formula: 

j t=t Q +T 

Eye(x o ,y o )=-- ^j(p{x 0 ,y o ,t) which, in the present example, leads 
to 

77 ( \ A + B 

20 Eye(x oy y 0 )=—^~- 

It should be noted that the proposed pattern, when inte- 
grated over time, always gives the same value for all panel 
cells. If this would not be the case, under some circum- 
25 stances, some cells might acquire an amplitude offset to 

other cells, which would correspond to an undesirable fixed 
spurious static pattern. 

While displaying moving _ obj ects on the plasma screen, the 
30 human eye will follow the objects and no more integrates the 
same cell of the plasma (PDP) over the time. In that case, 
the third dimension, will no more work perfectly and a dith- 
ering pattern can be seen. 



In order to better understand this problem, the following 
example of a movement V = (1;0) shall be looked at, which rep- 
resents a motion in x-direction of one pixel per frame. In 
that case, the eye will look at (x 0 ,y 0 ) at time t Q and then 
it will follow the movement to pixel (x 0 +l,y 0 ) at time t Q +l 
and so on. In that case, the cell seen by the eye will be 
defined as following: 

which corresponds to 
Eye = ^(A + A + ... + A)=A . 

In that case, the third dimension aspect of the dithering 
will not work correctly and only the spatial dithering will 
be available. Such an effect will make the dithering more or 
less visible depending on the movement- The dithering pat- 
tern is no longer hidden by the spatial and temporal eye in- 
tegration. 

The invention relates to a way of eliminating a dithering 
pattern appearing for a viewer observing a moving object on 
a picture. 

The present invention proposes a method for processing video 
data for display on a display device having a plurality of 
luminous elements by applying a dithering function to at 
least part of said video data to refine the grey scale por- 
trayal of video pictures of said video data, computing at 
least one motion vector from said video data and changing 
the phase, amplitude, spatial resolution and/or temporal 
resolution of said dithering function in accordance with 
said at least one motion vector when applying the dithering 
function to said video data. 

Furthermore, according to the present invention there is 
provided a device for processing video data for display on a 
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display device having a plurality of luminous elements in- 
cluding dithering means for applying a dithering function to 
at least a part of said video data to refine the grey scale 
portrayal of video pictures of said video data, and motion 
5 estimation means connected to said dithering means for com- 
puting at least one motion vector from said video data, 
wherein the phase, amplitude, spatial resolution and/or tem- 
poral resolution of said dithering function is changeable in 
accordance with said at least one motion vector. 

10 

Fortunately, the dithering function or pattern has two spa- 
tial dimensions and one temporal dimension. Such a dithering 
function enables an enhanced reduction of quantization steps 
in the case of static pictures compared to error diffusion. 

15 

The dithering function may be based on a plurality of masks. 
Thus, different dither patterns may be provided for differ- 
ent entries in a number of least significant bits of the 
data word representing the input video level. This makes it 
20 possible to suppress the disturbing patterns occurring on 

the plasma display panel when using the conventional dither 
patterns. 

Furthermore, the application of the dithering function or 
25 pattern may be based on single luminous elements called 

cells of the display device. I.e. to each colour component 
R, G, B of a pixel separate dithering numbers may be added. 
Such cell based dithering has the advantage of rendering the 
dithering noise finer and thus making it less noticeable to 
30 the human viewer. 

The dithering may be performed by a 1-, 2-, 3-, and/or 4- 
bit function. The number of bits used depends on the proc- 
essing capability. In general 3- bit dithering is enough so 
35 that most of the quantization noise is not visible. 
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Preferably, the motion vector is computed for each pixel in- 
dividually. By doing so the quality of higher resolution 
dithering can be enhanced compared to a technique where the 
motion vector is computed for a plurality of pixels or a 
5 complete area . 

Furthermore, the motion vector should be computed for both 
spatial dimensions x and y. Thus, any movement of an object 
observed by the human viewer may be regarded for the dither- 
10 ing process. 

As already mentioned, a pre-correction by the quadratic 
gamma function should be performed before the dithering pro- 
cess. Thus, also the quantization errors produced by the 
15 gamma function correction are reduced with the help of dith- 
ering. 

The temporal component of the dithering function may be in- 
troduced by controlling the dithering in the rhythm of pic- 
20. ture frames. Thus, no additional synchronisation has to be 
provided. 

The dithering according to the present invention may be 
based on a Cell-based and/or Multi-Mask dithering, which 
25 consists in adding a dithering signal that is defined for 

every plasma cell and not for every pixel. In addition, such 
a dithering may further be optimized for each video level. 
This makes the dithering noise finer and less noticeable to 
the human viewer. 

30 

The adaptation of the dithering pattern to the movement of 
the picture in order to suppress the dithering structure ap- 
pearing for specific movement may be obtained by using a mo- 
tion estimator to change the phase or other parameters of 
35 the dithering function for each cell. In that case, even if 
the eye is following the movement, the quality of the dith- 
ering will stay constant and a pattern of dithering in case 



of motion will be suppressed. Furthermore, this invention 
can be combined with any kind of matrix dithering. 

Drawings 

Exemplary embodiments of the invention are illustrated in 
the drawings and are explained in more detail in the follow- 
ing description. In the drawings: 

Figure 1 shows the principal of the pixel -based dithering 
and cell based dithering; 

Figure 2 illustrates the concept of 3 -dimensional matrix 

0 

dithering; and 

Figure 3 shows a block diagram of a hardware implementation 
for the algorithm according to the present inven- 
tion. 

Figure 4 shows another embodiment for the block diagram. 
Exemplary embodiments 

In order to suppress the visible pattern of a classical ma- 
trix dithering in case of moving pictures the motion of the 
picture is taken into account by using a motion estimator. 

This .will provide, for each pixel M(x o ,y Q ) of the screen, a 

vector V{x o9 y 0 )=ty x (x o9 y 0 \V y (x o9 y 0 )) representing its movement. In 

that case, this vector can be used to change the phase of 
the dithering according to the formula: 

9(x o ^V x (x o9 y o \y 0 -V y {x 0 , y 0 \t Q ) . 

More generally, the new dithering pattern will depend on 
five parameters and can be defined as following: 
C(x 0 ,y 0 ,V x (x o9 y o \V y (x o ,y o \t) . 
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A big advantage of such a motion compensated dithering is 
its robustness regarding the motion vector. In fact, the 
role of the motion vectors is to avoid any visible pattern 
of the dithering during a movement that suppresses the tem- 
5 poral integration of the eye. Even if the motion vectors are 
not exact, they can suppress the pattern. 

According to a more optimised solution, for each pixel M(x Q , 

— ► 

y Q )of the screen, a vector V(x o ,y o ,t o ) = (V x (x 0 ,y o J o \V y (x 0 ,y 0y t 0 )) 

representing its movement at time t Q is provided. In that 
10 case, this vector is used to change the phase of the dither- 
ing according to the formula : 

<p( x o~ fx( x o^yo^o\y 0 -f y (x o9 y 09 t o ) 9 t o ) 

where f (x,y,t) is a recursive function described as follow- 
ing : 

15 f x (Xo,y 0 / 1 0 ) = (V x (Xo,yo, t 0 ) + fx(x 0 ,y 0/ t 0 -l) )mod(x) and 
f y (x 0 ,y 0 , t 0 ) = v y (x 0 ,y 0 , t 0 ) + f y (x 0f y 0 , t 0 -l) )mod(x) . 
In this formula, x represents the period of the dithering 
and mod(x) the function modulo x. For instance if x=4, there 
is a periodic dithering pattern on 4 frames, which means 

20 that (p (x 0/ y 0 / 1 0 ) =q> (x 0/ y 0 f t 0 +4) and the modulo 4 functions means 
that : (0)mod(4)=0, (1) mod (4 ) (2) mod (4) =2 (3)mod(4)=3, 
(4)mod(4)=0, (5)mod(4)=l, (6) mod (4 ) =2", (7)mod(4)=3 and so 
on . 

More generally, the new dithering pattern will depend on 
25 five parameters and can be defined as following : 

t> (x 0 ,yo,v x (x 0 ,y 0 , t) ,v y (x 0 ,y 0/ t) ,t) . The only difference now is 
that the vectors used are taken from more than one frame. 
Preferably 3 -bit dithering is implemented so that up to 8 
frames are used for dithering. If the number of frames used 
30 for dithering is increased, the frequency of the dithering 
might be too low, and so flicker will appear. Mainly 3-bit 
dithering is rendered with a 4 -frames cycle and a 2D spatial 
component . 
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Figure 3 illustrates a possible implementation for the algo- 
rithm. RGB input pictures indicated by the signals R 0 , G 0 
and B 0 are forwarded to a gamma function block 10. It can 
consist of a look up table (LUT) or it can be formed by a 
5 mathematical function. The outputs R lt Gi and B x of the gamma 
function block 10^ are forwarded to a dithering block 12 
which takes into account the pixel position and the frame 
parity as temporal component for the computation of the 
dithering value. The frame parity is based on the frame num- 
10 ber within one dithering cycle. For instance, within a 3 -bit 
dithering based on a 4-frames cycle the frame number changes 
cyclically from 0 to 3 - 

In parallel to that, the input picture R 0 , G 0 and B 0 is also 
15 forwarded to a motion estimator 14, which will provide, for 
each pixel, a motion vector (V x/ V y ) . This motion vector 
will be additionally used by the dithering block .12 for com- 
puting the dithering pattern. 

20 The video signals R x , G x , Bi subjected to the dithering in 

the dithering block 12 are output as signals R2 , G2 , B2 and 
are forwarded to a sub- field coding unit 16 which performs 
sub-field coding under the control of the control unit 18. 
The plasma control unit 18 provides the code for the sub- 

25 field coding unit 16 and the dithering pattern DITH for the 
dithering block 12 . 

As to the sub- field coding it is expressively referred to 
the already mentioned European patent application EP-A-1 136 
30 974 . 

The sub- field signals for each colour output from the sub- 
field coding unit 16 are indicated by reference signs SF R/ 
SF G , SF B . For plasma display panel addressing, these sub- field 
35 code words for one line are all collected in order to create 
a single very long code word which can be used for the 
linewise PDP addressing. This is carried out in a serial to 
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parallel conversion unit 20 which is itself controlled by 
the plasma control unit 18. 

Furthermore, the control unit 18 generates all scan and sus- 
5 tain pulses for PDP control. It receives horizontal and ver- 
tical synchronizing signals for reference timing. 

Figure 4 illustrates a modification of the embodiment of 
figure 3. In this case, a frame memory is used at the dith- 

10 ering block level. The additional memory requirements are 
not so strong since the value to be stored is modulo x, 
which is mainly around 4 for standard dithering in order to 
limit the temporal visibility of the dithering (low fre- 
quency) . In that case, 2 bits per pixels are enough to store 

is values that are modulo 4 . For instance a WXGA panel will re- 
quire 853x3x480x2=2.34 Mbit. 

Although the present embodiment requires the use of a motion 
estimator, such a motion estimator is already mandatory for 
20 other skills like false contour compensation, sharpness im- 
provement and phosphor lag reduction. Since the same vectors 
can be reused the extra costs are limited. 

Motion compensated dithering is applicable to all colour 
25 cell based displays (for instance colour LCDs) where the 
number of resolution bits is limited. 

In all cases the present invention brings the advantages of 
suppressing the visible pattern of classical matrix dither- 
30 ing in case of moving pictures and of strong robustness re- 
garding the motion vector field. 



